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To  be  presented  at  the  Joint  AIIE-ORSA-TIMS 
Symposium  on  System  Simulation^  Hotel  Statler, 
Net  York  City,  May  16-17,  1957. 

(In  conjunction  with  P-1075,  Simulation  In 
RAND's  Logistics  System  Laboratory, by 
NlHlam  W.  Haythom,  and  SP-6,  Simulation  In 
Air  Force  System  Tralnlng,by  ‘niomas  C.  Rowan.) 
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The  Netd,  the  Concepts,  the  Approach 

Operations  analysis  and  system  analysis  often  need  to  ocai- 
slder  the  effect  of  the  human  factor  on  system  performance. 
Usually  a  "degradation  factor"  Is  used  to  qualify  the  predicted 
effectiveness.  In  an  effort  to  better  understand  the  human 
element  in  systems,  RAND  set  up  the  System  Research  Laboratory 
to  study  man's  performance  in  complex  man-machine  systems. 

The  imderlying  notion  behind  this  researoh  iras  that  it 
might  be  possible  to  obtain  the  predictable  features  of  a 
"closed''  system  by  exploiting  roan's  capacity  to  seek  and  find 
problem  solutions.  That  is,  if  man  could  be  motivated  to  seek 
»ytem»s  goal,  and  if  he  were  provided  knowledge  of  opera¬ 
tional  results,  a  disparity  between  actual  and  desired  perfone- 
ance  might  serve  as  an  error  feedback  to  trigger  adaptation  of 
operating  practices  to  improve  effectiveness. 

To  explore  this  possibility,  a  particular  man-maohine 
system,  a  part  of  the  air-defense  network,  was  simulated  in  the 
laboratory.  Included  in  the  laboratory  system  were  ndt  only 
functional  representations  of  the  machine  coapenents  but  also 
the  men  themselves— under  such  conditions  as  to  pendt  them  the 
latitude  of  action  found  in  the  real  world.  Sueh  a  ayetem  was 
exposed  to  successively  more  difficult  task  situatieas,  the 
results  of  performance  were  reported  back  to  the  oreWf  and  the 
questions  asked  were:  Could  men  learn  to  improve  system  per¬ 
formance;  "what"  did  they  leami  and  "why"  did  they  loam? 
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Four  experiments  were  cenrled  out.  Each  involved  about 
forty  men  and  extended  over  a  six-week  period.  The  results  were: 
the  crews  did  learn — aux^rislngly  well  (Increased  their  load- 
carrying  capacity  several  fold);  what  they  learned  was  to  dis¬ 
tinguish  between  important  and  unimportant  information  input  and 
to  shortcut  their  data-processing  procedures;  why"  they  leai^uid 
seems  to  be  found  in  the  well-known  answers — practice,  under 
realistic  conditions,  and  knowledge  of  results. 

Because  of  the  implication  of  these  results  for  improving 
aiivdefense  effectiveness,  RAND  was  asked  to  develop  a  System  Training 
Program  for  the  Air  De: er.se  Command.  his  program  has  been  under 
way  for  several  years;  Dr.  Rowan  will  discuss  the  extension  of 
the  laboratory  simulation  techniques  to  the  field  situation  and 
the  progress  that  has  been  made  in  enriching  the  simulation  and 
developing  production  methods  for  producing  problem  material.^ 

Somewhat  later  RAND  was  asked  to  apply  simulation  techniques  to 
the  study  of  the  Air  Force  Logistics  system;  Dr.  Haythom  will 

report  progress  in  adapting  these  methods  to  a  problem  having 

2 

quite  different  demands. 

lAiile  the  other  RAND  speakers  will  report  their  research 
activities  in  specific  terms,  I  will  discuss  quite  generally  the 
principles  and  implications  arising  from  the  original  work  on 
simulation  at  RAND. 

^Sinulation  in  Air  Force  System  Training  -  T.  C.  Rowan,  SP-6, 

April  30,  1957. 

^Simulation  in  RAND's  Logistics  System  Laboratory,  N.  W.  Haythom, 
P-X075,  April  30.  1957. 
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The  Simulation  Techniquts  and  Their  Limltatlona 

There  are  obviously  many  different  phenomenon  to  be  simu¬ 
lated,  using  a  variety  of  techniques,  and  for  a  multitude  of 
purposes — as  the  speakers  o^  this  syinpo8i\iin  are  sure  to  point 
out.  It  may  be  appropriate  to  circumscribe  soisewhat  what  kind 
of  simulatiwu  «««  liuttti  speakers  from  RAND  will  be  talking  about. 

We  are  concerned  with  the  exploitation  of  nan's  capability  for 
finding  solutions  to  con^lex  problems,  because  we  feel  that 
this  resource  must  be  used  if  the  intricate  systems  of  the 
present  day  are  to  develop  their  full  potential.  And  so  wt  try 
to  simulate  the  complex  environment  in  which  men  work  to  dis¬ 
cover  efficient  operating  procedures  and  how  men  can  be  aided 
in  their  search  for  these  procedures,  (other  research  at  RAND, 
of  course,  is  devoteo  to  siaolatlng  systeas  o«Np4.etely  by  maohlM.) 

Pig.  1  shows  how  respective  elements  of  the  real  world 
situation  were  translated  by  simulation  techniques  into  their 
laboratory  counterparts.  Several  methods  were  used:  the  genera¬ 
tion  of  the  system's  complex  information  inputs  by  means  of 
electronic  computers;  the  construction  of  the  laboratory  replioa 
of  the  physical  aspects  of  the  real  system  using  an  amount  of 
stagecraft;  bringing  the  real  world  culture  into  the  laboratory— 
the  art  of  carrying  out  psyoho logical  experiments  helps  us  here, 
as  well  as  in  motivating  and  shaking  down  a  new  orew. 

These  simulation  techniques,  which  seemed  to  be  quite  sue- 
cessful  in  stisulating  realistic  system  activity,  Just  barely 
scratch  the  surface  of  simulation  requirem«its.  In  the  four 
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defense  expez*iment8f  for  exan^le,  only  the  oom^lex  Infomtlon 
Inputs  were  programmed  for  machine  coBq;)utation;  playing  out  the 
oensequences  of  system  action  (the  fighter- bomber  duel  once  the 
interceptor  had  made  contact,  for  instance)  was  carried  out  by 
hand.  For  many  systems,  the  implications  of  their  actions  will 
be  so  intricate  as  to  require  machine  programs.  It  was  also 
possible  in  this  aW -defense  study  to  play  in  real  tiii»  and  to 
have  a  man-for-nmn  match  between  lab  and  real-life  crew.  Dr. 
Haythom  will  discuss  extensions  of  simulation  methods  needed 
for  the  logistics  study  along  both  these  lines:  mechanizing 
the  involved  embedding  systems  and  time-personnel  aggr«gation-- 
having  several  people  in  the  lab  represent  many  in  the  real 
world  and  simulating  action  faster  than  real  time. 

The  air-defense  problem  permitted  distorting  input  simula¬ 
tion  into  static  form.  That  is,  the  problem  situations  could  be 
preconqputed,  because  they  were  not  much  affected  by  system  actions. 
However,  a  dynamic  stimulus  is  required  when  system  actions  feed 
back  and  influence  the  problem  situation  to  a  large  degree.  Dr. 
Rowan  will  talk  about  the  technological  advances  in  machine 
generation  of  Inputs  necessary  for  field  application  of  simula¬ 
tion  techniques — both  to  produce  the  needed  quantity  and  quality 
Of  material;  these  advances  may  very  well  lead  to  the  capability 
of  providing  the  dynamic  stimulus. 

Another  limitation  is  a  substantive  one.  Simulation  can  be 
done  only  as  our  understanding  of  phenomena  will  permit.  Cer¬ 
tain  activities  can  be  modeled  with  confidence — the  time-space 
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relatlons  of  an  aircraft's  flight  and  the  radar  detection  of 
that  flight.  Other  activities^  however,  cannot  be  represented 
mathematically  with  precirlon,  such  as,  the  effects  on  the 
national  economy  of  pricing  practices.  So  we  will  have  to 
select  for  simulation  those  activities  valid  theories  can  model 
for  us  or  suffer  the  uncertainties  in  results  that  approxima¬ 
tions  give  us. 

Ihe  Scope  of  Applications  and  Practical  Criteria  for  Use 

Rapid  technological  developsmnts  of  the  last  several  de¬ 
cades  have  exposed  wide  vistas  of  opportunity.  Not  only  our 
military  but  our  industrial  institutions  as  well  have  been 
vastly  empowered.  But  along  with  this  opportunity  is  posed 
the  accentuated  need  for  the  effective  use  of  these  teohnioal 
Innovations.  Tremendous  commitsient  of  resources  is  required 
to  establish  such  tecnnologically-enriched  systeus.  And  the 
hope  is  that  they  will  continue  to  prove  adequate  in  the  faoe 
of  clianging,  and  seemingly  uncertain,  world  conditions • 

Simulation  is  only  one  method  for  studying  and  iapreving 
the  nanagesient  of  our  limited  resources,  but  one  having  parti¬ 
cular  advantages  (and  disadvantages).  Several  applleatiens  of 
this  technique,  and  practical  criteria  for  its  use,  can  be  sug¬ 
gested.  The  other  RAND  speakers  will  focus  on  the  use  of  simu¬ 
lation  studies  to  design  and  pretest  proposed  systesM  and  to 
develop  training  Mthods.  1  would  like  to  swntlon  another  hope 
of  this  research— that  which  initially  motivated  the  aii^dwfoaso 
experiments. 
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We  wished  to  develop  &  theory  of  man-machine  systems,  to 
model  the  system  for  whose  benefit  an  environment  Is  simulated. 
Some  progress  along  this  line  can  be  reported,  but  the  gener¬ 
ality,  and  validity,  of  our  model  remlns  to  be  evaluated. 

The  ln5)llcatlon3  of  this  formulation  seem  to  promise  practical 
help  In  the  design,  training,  and  management  of  systems. 

Some  of  our  theory  Is  Implicit  n  the  following  discussion 
of  criteria  to  use  In  deciding  whether  this  kind  of  simulation 
Is  to  be  used. 

System  designers,  and  operators  too,  are  frequently  plagued 
by  uncertainty:  uncertainty  about  the  situations  the  system 
will  face  (raising  questions  of  how  much  Information- gathering 
ability,  data-processlng  capacity,  and  action  potential  to  build 
In);  uncertainty  about  technological  breakthroughs  to  come  and 
how  they  can  be  incorporated  in  an  established  system  (how  data- 
processlng  mechanisms  can  be  adapted  to  new  information  and  res¬ 
ponse  repertories);  uncertainty  about  how  to  match  output  against 
input  (what  is  the  appropriate  reaction  to  certain  Information). 

If  there  Is  a  large  payoff  for  reducing  the  uncertainty  of 
the  input-output  match  or  for  maintaining  flexibility  in  system 
operation,  periiaps  a  simulation  study  Is  Indicated.  (Actually, 

In  some  cases,  simulation  Is  the  only  feasible  approach,  as 
soste  of  Dr.  Rowan's  reaiarks  will  Illustrate.)  The  chief  advan¬ 
tage  of  simulating  man-machine  systems  over  other  research 
techniques  Is  that  it  permits  the  exploration  of  a  wider  range 
of  alternatives  In  integrating  information,  devising  responses, 
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ani  In  matching  the  two.  Men  who  operate  eyatema  can,  in  fact, 
perforn  effectively  in  aituationa  which  are  extremely  oooqplloated 
while  scientific  analysts  can  solve  problems  only  in  the  aiaplfr 
realm  that  th^ir  nw*thof^s  can  circumscribe. 

Ihe  increase  in  system  potential  or  reduction  in  ayatem 
vulnerability  that  can  be  realized  through  simulation  studies 
will  often  warrant  the  expense  of  such  a  study  (and  they  can  be 
expensive,  both  in  time  and  money).  We  all,  of  course,  look 
forward  to  the  day  when  we  can  predict  the  usefulness  of  design 
and  management  interventions  in  a  aan-aaohine  system  from  a 
valid  model.  And  it  la  to  that  end  that  our  separate  endeavors 
should  all  contribute. 


SIMULATION  TECHNIQUES  THE  "LAB"  SITUATION 
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